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Let K x (s,t) and K 2 (s,t), — T^s,t^ T,be real, symmetric, continuous 
and strictly 'positive-definite kernels, and denote by K x and K 2 the cor- 
responding integral operators. Let x{t) be a sample junction of either of 
two zero-mean processes with covariances Kx(s,t) and K 2 (s,t). We prove 
a generalized version of the following: If the integral equation 

has formal solutions X, and ^,-(i) which may contain 8-f unctions, and 
if [Ki\pi\ forms a complete set in £ 2 [—T,T], then (i) the two kernels have 
the following simultaneous diagonalization: 

K 2 (s,t) = ZHKMisXK^Mt), 

uniformly on [—T,T] X [— T, T], and (ii) the sample function has an 
expansion 

x(t) = Z (x,+Wih)U) 

in the stochastic mean, uniformly in t, and the coefficients are simul- 
taneously orthogonal, i.e., 

BxKxJMxM] = 8 if , ff.{Cr,*)(s,6)) - X, 8 it , 
where (.r,^,) is obtained by formally integrating ^,-(i) against x(t). 

I. INTRODUCTION 

Let Ki(s,t) and K 2 (s,t), —T^s,t^T,be real, symmetric, con- 
tinuous and strictly positive-definite kernels, and denote by K t and 
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K 2 the integral operators with kernels -K",(s,j!) and K 2 (s,t). We have 
previously 1 established that, if K^ h K 2 K^ is a densely defined and 
bounded operator on £ 2 (the space of all square-integrable functions 
on [— T,T\) and if its extension to the whole of £ 2 has eigenvalues 
X, and complete orthonormal eigenf unctions <Pi(t), i = 0, 1, • • • , then 
the two kernels have the following simultaneous diagonalization: 

(i) 

K 2 (s,t) = Z HK\<p t )(s)(K\<fd(t) 

uniformly on [—T,T] X [— T,T\. In addition, if x(t) is a sample func- 
tion of either of two (separable and measurable) zero-mean processes 
with covariances Ki(s,t) and K 2 (s,t) with associated measures Pi and 
P 2 , then 

x(l) = £ *<4CKln)<0 (2) 

in the stochastic mean, uniformly in t. Moreover,* 

EtMxhM) = *<i . #■{*(*)*(*) I = X. 8<, , 
wheref 

m(x) = lim (x,KTW) (3) 

n-»oo 

in the stochastic mean, and [<p in ] is any sequence of functions in the 
domain of K^ such that lim || ?,- - <p in \\ = 0. 1 ' 2 Furthermore, if the 
two kernels have continuous 2rth derivatives (d 2r /ds r dt r )K P (s,t), p = 
1, 2, then (1) and (2) can be differentiated term-by-term r times while 
retaining the same senses of convergence. 

We remarked in Ref. 1 that, if <p { is in the domain of K^, ^ = ETV»< 
satisfies the integral equation 

(KM® = HKM(t), -T£t<L T, (4) 

and 

y t (x) = (xrfi) a.s. (almost surely), ,^ 

(K\ Vt )(t) = (KM(t). 

Slepian (private communication) has long conjectured that, if (4) 
admits formal solutions X, and ^< , i = 0, 1, • • • , where ft may contain 

* E p , p = 1, 2, denotes the expectation with respect to P p . 

t For any /, ge£ 2 , (f,g) denotes the inner product of/ and g, and || / || the norm 
of/. 
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5-functions and their derivatives, then the expansion coefficients and 
functions of (2) are given by formally substituting such \f/ { into (5).* 
This conjecture, proved here, is significant since it provides a concrete 
means of obtaining the expansions (1) and (2). To illustrate the point, 
consider the following pair of covariance kernels: 

KiisJ) =<f al -" ( K 2 (s,t) -a""- 11 . 

For this pair, (4) admits the following formal solutions 8 

9M = cos e k t + ^-M! [s(t _ T) + 5(/ + T)l 



k = 0,l, .-• , 

fc 4+1 (/) = sin 6 k t + S ^J [S(t -T)- 8(t + T)], 

corresponding to 

^ P " + el a + 9l 

A " " a /3 2 + dl ' -* + I " a /3 2 + M ' 

where 0* and 6 k are positive solutions of 

(a + 0)0* tan 0*T = a/5 - 0?. , 
-(a + 0)0\ ctn t T = a/3 - 0* , 
respectively, indexed in ascending order. Thus, formally, 

(xM = f x(t) cos ej dt + ^f WW + *(-m 

J-7- a -f- p 

(x,f 2k+1 ) = f x(t) sin 6 k t dt + S -^f [x(T) - x(~T)], 
J-t a + /3 

(#,&*)(/) = 3 -r- fl2 COS 0,/, 



(6) 



(8) 



(9) 



(10) 



(ff a fc* + i)(0 = iT^ siD 0,/. 
a + 0t 

Through a direct calculation, we previously 5 established that 

(i) K^i^^i" 1 is densely defined and bounded, 
(ii) its extension has eigenvalues \, given by (7) and complete 



.Similar conjecture's have been made elsewhere. 34 



886 THE BELL SYSTEM TECHNICAL JOURNAL, MAY-JUNE 1967 

orthonormal eigenfunctions cp { given as 

tPi = c, l.i.m. 2Z MuGfa . fu)fii . 



(iifirji = Ci(x,4>i) a.s.,* K\<pi = CiKi$ t , which verifies Slepian's 
conjecture for this example. Here c, is a normalization constant given by 



C,v = 



.«' + 



(a + gWj 

^(a' + ^ + aV/J ' 



C 2 k + 1 — ^2* 



(that is, c 2 *+i is obtained by replacing 6 h with 0* in c 2fc ), n vi and / PJ - , 
p = 1, 2, j = 0, 1, • • • , are the eigenvalues and orthonormal eigenfunc- 
tions of K v , and (^ t , f u ) is defined analogously to (9). 

In this paper we prove the generalization of (i), (H), and {Hi), starting 
with abstract kernels K x {s,t) and K 2 (s,t) and a generalized version of 
the integral equation (4). 

II. MAIN RESULT 

Theorem: Let K v (s,t), p = 1, 2, -T ^ s, t ^ T, be real, symmetric, 

strictly positive-definite kernels with continuous 2rth derivatives 

(d 2r /ds T dt r )K 1> (s,t). If there exist sequences of real numbers {a, Im }, 
[t m \: -T g t m ^ T, and {X,}: 

< 6, ^ A. ^ 6, , i = 0, 1, -•• , (11) 

/or some constants 6, and b 2 , and sequences of square-integrable functions 
\ypn), which satisfy the equation 

t, \ f 7 (j? K 2 (s,t))+ a (t) dt+£ a ilm jj£ K 2 (s,t) I 

- x < s [£ (£ «*■«)*«» * + £ "•'" S? ** M I ] ■ 

-t £ a ^ r, 

swcA tfiaJ //ie right-hand side of (12) /orras a complete set in £ 2 , then 
(i) K\~*K 2 K[* is a densely defined and bounded operator on «£ 2 , 
(ii) its extension to the whole of £ 2 has eigenvalues and complete ortho- 
normal eigenfunctions, which are the X, and 



*(•) = z 



(jtfoilMto + SflnA(8,0 



(13) 



* This portion is proved in a separate article. 6 
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(in) 77, and K\tp t of (2) can be given, respectively, by 

a.s. (14) 



i=() L m = l 



and 6?/ the right-hand side of (12) without X, . Here, JKjoi , p = 1,2, 
denotes an integral operator whose kernel is defined as 

KUs,t) = Z AtfMffi® l - 0, 1, • • • , r, (15) 

m 2/ie mean m s, uniformly in t. 

Remarks: 

(i) K* o ,(s,0 of (15) is well defined since 

E Mrt/rftofi'M = Jr^r #„(«,/), p = 1, 2, (16) 

uniformly in (s,t). 7 It follows from this that (15) converges in the 
mean in (s,t) as well. Hence, from Fubini's theorem, K\ ol (s,t) is a 
square-integrable function of t for almost every s. Thus, <p t (s) of (13) 
is well denned. We assume without loss of generality that ^, , i = 
0,1, • • • , are normalized. 

(it) For the example in Section I, r = 0, q = 2, ti = T, t 2 = — T, and 

^2*.o(0 = c,. t cos 6 k t, ^u+i.o(0 = c 2*+i sin 0*/, 

cos 0,7' 

a + P 

_ _ si n g/7 7 

a2t + i,n.! — a2t + i,n.2 — £24+1 ■ a 1 

b t = - , o 2 = - , 

/3 a 

the right-hand side of (12) without X,- is given by (10), and completeness 
of (cos 6 k t, sin d k t\ follows from (18) and a gap-and-density theorem. 8 

III. PROOF OF THEOREM 

For notational simplicity, we write K vkl , p = 1, 2, for the integral 
operator whose kernel is 

r.k+1 

K pkl (u,i!) = u t K p (u,v), k, I = 0, 1, • • • , r. 
ou dv 

K v00 and K\ m are abbreviated as before by K v and K\ , respectively. 
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(i) For any /, g e £ 2 , 

{K vQk j,K\ 0l g) = (f,K pkl g), (17) 

Kl 0l g= l.i.m. t,4iUfvi\9)' (18) 

To prove (17), note 

(KUIAiQ) = /// /(*)fl(0^Jo*(«,s)«Joi(w,/) ds d/ rfw 

- /* / Ks)g(D Z ihilSWJi® ds dt 

= (i,K pkk g), 

where the second equality follows from the mean convergence of (15) 
and the third from the uniform convergence of (16). To prove (18), 
consider 



Kloig ~ £/4//pi(/J!\ff) 



- (g,K Pll g) - Erf'.?) 2 > 



1-0 



which vanishes as n — > 00 since (16) converges uniformly in (s,t). 
(ii) KpK\ and K^K\ are densely defined and bounded on £ 2 . 
To prove this, apply Kl h on both sides of (12) and use (18) to obtain 

E \Ai*n + Z o.««^2*oi(-,ol - X.^2 5 ^, • 

/-0 L m-1 J 

Then, for each i, 

xiiixrtEfoir 

= z {(8i»*« , Ai*«) 



*,/-() 



+ Z [a lim (XL(-,0, XLfti) + a ikm (KL(-,L), AifcJ] 

m-l 
fc.l-0 IN ™ = 1 ' 

+ Z aj (K 2kl f {l )(t n ) + Z a ilm K 2kl (t n , L) 
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= x, Z \(xt»t«, , ft«*i + Ia, n Al„,(-,g) 

fc.f-0 L V m-1 / 

+ Z o.-*»(a'L( •,/..), Kfoi^i + i a it Moi(- ,t m )J 

= X,- || <pi || 2 , 

where the second equality follows from (17) and (18), the third from 
k time differentiation of (12) and from (17) and (18), and the last 
from (13). Hence, with <p t being normalized, 

WK^Kfai || 2 = ~, i = 0, 1, ••• . 

Now [(Pi\ is complete since the right-hand side of (12) without X, , 
which forms a complete set by hypothesis, is equal to K\<p { , and K\ 
is strictly positive-definite. Hence, from (11), K^K\ is densely defined 
and bounded. 

To prove that K^K\ is also densely defined and bounded, define 
(Pi as the normalized right-hand side of (13) with the subscript 1 re- 
placed by 2. Completeness of (£,} is similarly deduced via (12). Now, 
by following the same procedure with the roles of K x and K 2 inter- 
changed, we obtain 

|| £T*£fo II s = X, , i-0, 1, ... . 

Then, the assertion follows immediately from (11). 
(Hi) The ranges of K\ and K\ are equal, namely, 

K\(£ 2 ) = K* 2 (£ 2 ). 

To prove this, denote by L and M the extensions to the whole of 
£ 2 of K^K\ and K^K\ respectively, which exist as a result of (it). 
Since the domains of K\L and K\M are £ 2 , which is also the domains 
of K\ and K\ , we have 

K\ = K\L, K\ = K\M. 

Then, from the first equality, K\(£ 2 ) C Kl(£ 2 ), while, from the second, 
id(£ 2 ) C K\ (JE 2 ). Hence, the assertion holds. 

(*) 

KU-,t) = l.i.m. Z K\iu1u(t), -TgtgT, (19) 

n— oo i-fl 

K\ ol g = l.i.m. 2 Kt/u&T.ff). g e £ 2 . (20) 
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To prove (19), note first that /„• , j - 0, 1, • • • , are in the domain 
of K^ as a result of (Hi) and also that (K?f u , K\fu) = &u from 
orthonormality of {/„•}. Thus, [K?f l} } and {#*/„} form a pair of 
mutually reciprocal bases of £ 2 . Hence, 

KU-,0 - l-i-m. £ Kll u (K?1u , KU-,0)- (21) 

n-w 1=0 

But from (15) 
(K% , KU- t t)) = £ (/„■ , /.O/ffCO, I - 0, 1, • ' • ,r, (22) 

i-0 

uniformly in f. Now, since {/ 2 ,-} is an orthonormal basis of £ a , 
f u = l.i.m. £ (/„■ , hi)Ui ■ 

„-,„ ,=0 

But, according to (22), the right-hand side converges uniformly. Hence, 
the above partial sum must converge uniformly to f„. Suppose for 
some k, ^ k < r, 

1=0 

uniformly in t. Then, from (22), 

»=0 

uniformly in t." Hence, by induction, (23) holds for every k, ^ k ^ r. 
Therefore, from (22), 

CKrti*.*Li(-.0) = #"(')■ ' = 0. 1, ■•• ,r. 

Then, (19) follows from (21) and the above. 

To prove (20), we expand K\ ot g relative to [K\j u \: 

Kloig - l-i.m. J2 (K;% , K\ nl g)K\j u , 

n-«oo )' = 

and note from (18) and (23) that 

(K~ 2 % ,KLg) = tduthiXffl.Q) = MS. 

1=0 

(v) To prove (i) of the theorem, we note from (it) and (Hi) that 
Kr^i is everywhere-defined and bounded on £ 2 . Hence, its adjoint 
(K; h K\)* is also everywhere-defined and bounded. Now, for any 
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f e £ 2 and g e ©(AV), the domain of K { *, we have (K^K\f,g) = 
{j,K\K?g). Thus, K\K?g = (K^K\)*g, g e 3>(£T*). Hence, Kj^"» 
is bounded. Since T)(K^) is dense in £ 2 , we conclude that K x *K 2 K X * 
is densely denned and bounded. 

(vi) To prove (it) of the theorem, define 



>.„(/) - Z A Z 



/w(0. (24) 



m-l 

and note <£>,„ e £>(A7*) and lim || tp t — <p in \\ = 0. Then 

l.i.m. A' 2 A7W. = l.i.m. Z Z [(-Aw , A?) + £ «« JS'OO k«f„ 

n— oo n-.oo 1=0 f -<l L_ m-l J 

= Z K.o«^i + ta-iA»('.0 

1=0 L m = l J 

= \JS&p t , 

where the second equality follows from (19), (20), (15) and (18), and 
third from (12) and (13). Now denote by Q the extension of K?K 2 K^ 
to the whole of £ 2 • Then, 

K\Qj = l.i.m. K 2 K?j n 

n—ai 

for any / c £ 2 and {/„} : /„ e ©(ftf 1 ). lim || / - / n || = 0, since 

|| K\Qj - KJ&f m || ^ || «!(?(/ - /„) ll + H (K\Q - K 2 K;% II 

which vanishes as n — > <». Therefore, Qv.- = X,-^>, . Lastly, since {p,-} 
is complete in £ 2 , |X,| constitutes the entire spectrum of Q. 

(vii) To prove (iit) of the theorem, note from (3), (24) and (vi) that 



77,(.c) = l.i.m. X Z 



n-»oo 1=0 1=0 _ 



(*«, ■/;,") + Zanjt'tXo 



](/i, ,-r). 



Now 
E 



1=0 



Ey 



x in (0 - Z WuWiTM 



= K ul (t,t) - Zmw[/i?(0] 2 , 

»-0 
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both of which vanish as n -> » by virtue of (16). Also, with the use 
of (17) and (18), 

1-0 I 

= (#„ , K 2U ^i) -22 (hi , fu)(1u , iT«*«d 

1-0 

1.4 = 

KLhi - E ^J/u(/!! , .^«) 



A' 2 



* (,, (o - z w^pm 



= Jsr„,(<,0 -2 Z fi l i\tXK»io1u)(t) 



+ S tSWJKfflu . W - 



i.t-0 



Ai(-,0- E^JfirfffW 



both of which vanish as w -» » by virtue of (19) and (20). Therefore, 
upon combination of the above results, (14) is proved. 
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